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ABSTRACT 


This  paper  surveys  contemporary  research  involving  error  and 
sensitivity  analysis  approaches  useful  for  the  design  of  aids  for 
planning  and  decision  support.  Discussed  are  structural  sensitivity 
considerations  as  well  as  the  effects  of  errors,  for  both  single 
and  multi  attribute  cases,  in  estimation  or  elicitation  of  probabili¬ 
ties  and  utilities.  One  of  the  major  uses  for  sensivitity  analysis 
type  results  is  in  bounded  prioritization  of  alternatives  using 
ordinal  Information.  This  use  of  sensitivity  analysis  Is  discussed 
and  illustrated  with  exam^s. 
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1.  Introduction 


A  contemporary  effort  of  much  Interest  Is  the  design  of  evaluation  and 
choice  making  aids  for  planning  and  decision  support  processes.  These 
adjuvants  are  sometimes  called  management  Information  systems;  although  we 
feel  that  the  terms  decision  support  system,  or  planning  and  decision  support 
system,  are  more  appropriate.  A  central  purpose  In  use  of  these  systems  Is 
not  just  presentation  of  Information  representing  facts  and  values, but  the 
aggregation  of  this  Information  to  aid  In  evaluation  and  cholcenaklnq. 
Research  In  this  area  Involves  many  disciplines  and  perspectives;  and  thus 
we  have  a  large  scale  systems  problem.  There  are  a  number  of  sources  of 
error  In  the  design  of  decision  analysis  algorithms  for  planning  and  decision 
support  systems.  We  discuss  several  of  these  in  this  paper,  namely:  errors 
In  the  structure  of  the  decision  situation,  errors  in  the  elicitation  of 
probabilities,  and  errors  In  the  assessment  of  single  and  multiple  utility 
functions.  Also,  decisionmakers  sometimes  find  it  very  difficult  to  provide 
precise  (cardinal)  estimates  of  weights  and  find  it  much  less  stressful  to 
provide  ordinal  values.  As  shown  In  Section  4,  sensitivity  results  can 
often  then  be  used  to  Infer  priorities.  We  conclude  our  survey  and  pre¬ 
sentation  with  a  discussion  of  some  contemporary  research  needs  in  this 
area. 
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2.  Sensitivity  to  Probability  Estimation  Errors 

In  decision  analysis  problems  under  risk.  It  Is  necessary  to  obtain 
an  objective  or  subjective  estimate  of  the  probability  that  various  out¬ 
come  states  will  result  from  decision  alternatives.  Once  a  recommended 
decision  has  been  established.  It  Is  often  useful  to  determine  the 
magnitude  of  the  changes  In  the  state  probabilities  required  for  the 
recomnended  decision  to  become  less  desirable  than  another  decision  alter¬ 
native.  This  magnitude,  coupled  with  some  knowledge  of  the  quality 
of  the  state  probability  estimates,  can  be  used  to  determine  how  confi¬ 
dent  we  are  In  the  optimality  of  the  recommended  decision. 

We  consider  the  three  outcome  state  case  first;  then  we  generalize 
these  results  to  the  n  outcome  state  case.  For  convenience,  we  assume 
that  the  probability  associated  with  each  outcome  state  Is  Independent  of 
the  action  alternatives.  With  alternative  a1  we  associate  a  utility 
vector 

(uV-Iuj  uj  u\]  (2.1) 

and  we  write  for  the  outcome  state  probability 

PT  *  lPj  P2  P3i  (*-2) 

The  expected  utility  of  alternative  a*  is  then 

EUta1)  *  pT  u1  «  Pjuj  +  p2  Ug  +  p3  u3  (2.3) 

Now  suppose  that  the  probabilities  p^,  are  perturbed.  Since  we  must  maintain 
P1  +  p2  +  p3  *  1 •  P1  —  0  (2«*) 

we  must  have 

APj  ♦  ap2  +  ap3  *  0  (2.5) 
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By  substituting  Eq.  (2.4)  Into  Eq.  (2.3),  we  see  that  the  equation  for 
constant  expected  utility  Is  that  of  a  straight  line 

ElKa1)  -  uj  +  Pj(u]  -  uj)  +  p2(ug  -  uj)  (2.6) 

In  two  dimensions,  pj  and  p2.  The  difference  In  expected  utility  for 
alternative  1  and  j  Is  some  amount  A^  given  by 

A1^  *  EUta1)  -  EU(a^)  «  p^uj  -  u^)  +  p2(uj  -  u^)  +  p3(u3  -  u^)  (2.7) 

As  long  as  a^  ^  0  we  know  that  alternative  a^  Is  preferred  to  alternative 
a^.  The  relation  a^  *  0  graphs  as  a  straight  line  In  the  p^,  p2  plane 
If  we  make  use  of  Eq.  (2.4)  to  eliminate  p3>  Doing  this,  however,  distorts 
the  planes  of  Interest  somewhat.  Fortunately,  the  three  dimensional  space 
for  pj,  p2,  p^  becomes  a  plane  when  we  associate  the  constraint  of  Eq.  (2.4) 
with  this  space. 

Figure  (2.1)  Indicates  a  typical  probability  triangle.  It  is 
straightforward  to  show  that  graphs  of  A^  *  0  are  straight  lines  in  Figure  2.1. 
For  example,  the  graphs  of  a1^  *  0  for  the  problem  of  Table  2.1  are  shown 
In  Figure  2.1. 


Table  2.1  Illustrative  Utilities  for  a  Simple  Example 
Of  Interest  In  this  figure  Is  the  fact  that  alternative  1  dominates  altema 


-3- 


tlve  2  In  that  the  utility  of  each  outcome  state  Is  greater  for  alternative  1 
than  for  alternative  2.  Further,  It  Is  not  possible  for  alternative  4  to  be 

the  best  alternative  and  the  optimum  decision  regions  are  as  shown  in  Figure  2.2. 

For  more  than  three  outcome  states  .the  graphical  approach  suggested 
here  is  infeasible.  Isaacs  [l?j  and  Flshbum,  Murphy  and  Isaacs  [7]  describe 
a  general  approach  that  is  applicable  to  the  n  dimensional  case. 

This  approach  allows  determination  of  that  "second  best"  alternative  which 
could  become  the  best  alternative  due  to  a  minimum  overall  variation  in 
probability. 

There  are.  In  general,  a  variety  of  possible  ways  in  which  probability 
estimates  can  be  Incomplete.  Among  these  are  the  following  [6*  12j : 

1.  The  decision  maker  provides  an  estimate  of  the  p^ 

2.  The  decision  maker  provides  a  probability  density  function,  g(p^), 

for  the  p^. 

3.  There  exists  no  Information  about  the  p^ 

4.  There  exists  an  ordinal  measure,  or  ordering  of  the  p^.  For  conven¬ 
ience,  and  without  loss  of  generality,  we  may  assume  that  p^  >_ 

P2  —  *  •  •  —  Pn* 

5.  There  exists  bounded  internal  measures  such  that  each  p^  Is  bounded, 

such  as  a^  p^  with  a^  >  0,  >  0. 

6.  There  exists  a  set  of  inequalities  relating  the  P.,  such  as 

k+1  k  1 

£  Pi+l  —  P-i  —  P-j+i 
j*l  J+i  J  j=i  J+l 

7.  Some  of  the  p^  are  known  whereas  others  are  related  by  Inequalities 
of  the  forms  given  in  (4),  (5),  or  (6). 

There  exists  several  ways  In  which  the,  possibly  partial.  Information  con¬ 
cerning  probabilities  may  be  processed  to  assist  In  evaluation  of  the 


alternative  courses  of  action.  Among  these  are: 

(a)  The  estimate  of  the  p^,  if  provided,  may  be  used  to  obtain  the 

subjective  expected  utility  of  each  alternative  a^  from  the 
n  i 

relation  I  p,  u.  .  A  sensitivity  analysis  similar  to  that  of  our 
j*l  J  J 

Section  3  may  be  used  to  determine  the  possibility  of  a  decision 
switch  due  to  probability  elicitation  errors. 

(b)  The  expected  probability  of  each  event  outcome  may  be  computed 

A 

Pj  g(Pj)  dPj  and  the  Pj  used  in  place  of  the  p^. 
Estimates  of  subjective  expected  utility  are  obtained  as  In  (a)  above. 

(c)  Various  dominance  relations  may  be  obtained  from  the  ordinal  bounds 
and  bounded  Interval  measures  provided  by  the  decision  maker. 

(d)  Various  minimum  changes  for  a  decision  switch  may  be  obtained. 

(e)  Regions  in  which  various  alternatives  are  best  may  be  determined 
and  displayed  for  the  decision  maker. 

Often, various  forms  of  stochastic  dominance  [27,  28]  can  be  used  to 
eliminate  alternatives  from  consideration  even  when  there  exists  little  or 
no  information  concerning  event  outcome  probabilities.  For  case  3,  In  which 
there  exists  no  probability  Information,  alternative  j  will  dominate  alter¬ 
native  i  If  uJ  ^u^.with  the  Inequality  holding  for  at  least  one  component 
of  the  utility  vector.  In  component  form  this  becomes  uj|  >_  u^,  k=l,2...  n. 

For  example.we  easily  see  that  alternative  1  dominates  alternative  2  for  the 
alternatives  and  utilities  illustrated  in  Table  2.1.  This  may  be  written 


Further.it  Is  often  possible  to  identify  an  alternative  which  may  not  be 
dominated  but  which  is  inferior  to  or  dominated  by  a  mixed  strategy  con- 


from  P 


j 


■L 
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[ 


si  sting  of  a  mass  probability  FT  =  [F1,  F2,...,  F*"]  on  the  set  of 

primary  alternatives  a^  *  [a\  a2,...,  am].  If  the  decision  maker 

adopts  mixed  strategy  F,  then  alternative  a^  Is  elected  with  probability 

F^.  For  the  example  posed  by  the  data  Table  2.1  we  see  that  0.5  Uj 
3  4 

0.5  Uj  Uj,  j*  1 ,  2,  3.  Thus  alternative  4  Is  dominated  by  the  mixed 
strategy  F^  =  [0.5,  0,  0.5,  0,  0].  Consequently  we  may  delete  alternative 
4  from  further  consideration  for  the  particular  case  when  mixed  strategies  can 
be  considered  and  when  there  Is  no  Information  available  concerning  the 
proDaDllltles  of  event  outcomes.  It  is  dominated  by  the  mixed  strategy 
of  choosing  alternative  1  with  probability  0.5  and  alternative  3  with 
probability  0.5. 

In  the  general  case,  with  no  assessment  of  probabilities,  alternative  a1 
is  dominated  by  a  mixed  strategy  F,  assuming  the  probability  vector  p  is  the 
same  for  all  alternatives,  if 

z  F^  ujj  >  uj,  for  k  *  1,  2,  ....  n  l2*8) 

*  “  * 

If  there  exist  an  ordinal  ranking  of  probabilities,  as  in  case  4,  then 
we  can  easily  show  that  option  alternative  a^  is  dominated  by  a  mixed 
strategy  if  there  exists  a  mixed  strategy  F  such  that 

Z  F^(  ^  uj)  >  I  uj  for  j  *  1,  2,...,  m  (2.9) 

j*l  k*1  K  k*l  * 


Unfortunately  there  does' not  appear  to  be  any  method  that  is  general  and 
simple  to  use  to  determine  appropriate  mixed  strategies.  Often,  also,  the 
appropriateness  of  mixed  strategies  must  be  questioned  for  many  applications. 


For  the  case  where  there  exists  bounded  interval  measures  in  the  form 
of  case  5,  then  the  primary  strategy  alternative  a^  dominates  alternative 
aJ  if 


n 

E  .  [Z 

k«l 


lul  -  U {)]  >  0 


(2.11) 
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where  5  Is  the  minimum  value  of  the  objective  function  for  the  linear 

programming  problem 

n  11 
min  E  Xj(uk  -  ujj) 

subject  to  0  <_  xk  <_  ek 


n 

z 

k=l 


n 


°  k 


(2.13) 


(2.14) 


There  appear  to  be  no  general  formulae  for  cases  6  and  7  In  which  there 
exists  sets  of  inequalities  governing  the  p..  For  any  given  set  of 
inequalities,  we  may  write  equations  involving  expected  utilities  and  then 
equate  coefficients.  A  paper  by  Barron  [1]  provides  two  detailed  examples 
of  computations  involving  these  inequalities.  Additional  details  concerning 
sensitivity  of  decisions  to  probability  estimation  errors  may  be  found  in 
16,  7,  23,  28,  29]. 
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3.  Sensitivity  to  Variations  in  Utility-Single  Attribute  Utility  Functions 

for  Decisions  Under  Uncertainty 

In  this  section,  we  examine  sensitivity  relations  to  changes  in 
utility  functions.  This  section  will  concern  the  single  attribute  case. 

We  will  extend  the  results  in  this  section  to  the  scalar  multi attribute 
case  in  the  next  section.  The  vector  multi  attribute  is  considered  in  t2Rj. 
When  considering  utility  function  changes,  it  is  convenient  but  not  at  all 
necessary  to  consider  that  the  same  output  value  or  utility  function  is 
common  to  all  alternatives  and,  therefore,  represent  different  alterna¬ 
tives  by  different  probability  density  or  mass  functions. 

For  the  continuous  state  case,  we  consider  a  utility  function  u(x) 
and  alternative  a1  defined  by  the  associated  probability  density  function 
f7(x).  For  the  finite  state  case  we  consider  a  utility  function  u(x^), 
i  =  1,  2,  ...»  n  and  alternatives  aJ  defined  by  an  associated  probability 
mass  vector  function  PJ  which  has  n  components,  (pJ)T  =  lP^(x>),  PJ(Xg),... 
PjUn)]  =  [P°,  pj,...,  P;j]. 

There  are  a  variety  of  ways  in  which  utility  estimates  can  be  stated, 
possibly  incompletely.  Among  these  are  the  following: 

1.  The  decision  maker  may  provide  a  complete  estimate  of  the  value 
function  v(x)  and  utility  function  u(x) 

2.  The  utility  function  u(x)  or  value  function  may  be  completely 
unspecified. 

3.  Only  ordinal  preferences  are  specified. 

4.  The  value  function  may  be  specified  but  not  the  risk  aversion 
coefficient.  In  this  case,  the  utility  function  is  unspecified. 

If  the  value  and  utility  function  are  completely  specified,  the  expected 


utility  of  each  alternative  may  be  computed  and  a  sensitivity  analysis 
similar  to  that  of  Section  4  conducted  to  determine  the  potential 
of  a  likely  decision  switch  due  to  utility  and  value  function  elicitation 
errors.  If  the  value  function  is  cumpletely 
unspecified,  then  the  decision  maker  is  inchoate  and  there  is  virtually 
nothing  that  can  be  done  to  aid  the  decision  maker  except  through  proce¬ 
dures  that  will  enhance  the  value  coherence  of  the  decision  maker. 

Much  information  concerning  alternative  option  preferences  can  be 
obtained  from  just  an  ordinal  ranking  of  preference  for  outcome  states. 

In  the  sequel  we  will  assume  that  the  decision  maker  can  always  express 
an  ordinal  preference  for  the  value  of  event  outcomes  of  the  form  v(x^)^ 
v(x2)<  ....  <v(xn). 

When  ordinal  preferences  among  event  outcomes  can  be  elicited,  and 
when  probability  estimates  of  occurence  of  these  states  can  be  obtained, 
then  concepts  of  stochastic  dominance  can  be  used  to  determine  bounds  on 
alternative  preferences.  And  if  values  but  not  utilities  are  specified, 
then  it  will  often  be  possible  to  specify  risk  aversion  coefficients  which 
bound  alternative  preferences.  We  will  illustrate  each  of  these  claims 
by  means  of  a  simple  example.  Prior  to  doing  this,  however,  it  is 
desirable  to  establish  some  fundamental  concepts  concerning  stochastic 
dominance  129]. 

We  say  that  alternative  a1  is  preferred  to  alternative  aJ  whenever 
the  expected  utility  of  alternative  a1  is  greater  than  that  for  alternative 
a^.  In  symbols,  we  have  if  a^  aJ 

/•  fi(x)  u(x)  dx  >  r° f.(x)  u(x)  dx  13.1) 

aOO  -  Oo  ^ 
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where  fj(x)  is  the  probability  density  function  for  the  event  outcome,  x, 
associated  with  alternative  aS  and  u(x)  Is  the  utility  of  the  outcome 
states.  We  wish  to  provide  for  a  value  function  v(x)  and  will  restrict 
this,  for  convenience  to  the  interval  [0,  1],  The  value  function  is  not 
necessarily  a  monotone  function  of  the  outcome  states,  x.  The  utility 
function,  however,  should  be  isotone  in  v.  Thus  it  is  convenient  to 
rewrite  Eq.  (3.1)  as  a*  ^  a^  if 


f.(v)  u(v)  dv 


f.(v)  u(v)  dv 

J 


(3.2) 


where  we  realize  that  the  utility  function  is  written  as  u [ v ( x ) ]  but 
where  we  delete  the  x  symbol  for  convenience. 

Stochastic  dominance  concepts  are  based  upon  the  imposition  of  a  series 
of  increasing  constraints  upon  the  form  of  the  utility  function  u(v).  The 
most  trivial  assumption  is  that  utility  is  a  monotone  increasing  function 
of  increasing  value.  Thus  we  require  du(v)/dv  =  u'(v)  >_  0.  We  now  inte¬ 
grate  Eq.  (3.2)  by  parts.  Since  we  have 


we  obtain  for  Eq.  (3.2) 


lPi(v)  -  Pj(v)]  u'(v)  dv  ^  0 


(3.3) 


Without  specification  of  u(v)  but  with  specification  that  u'(v)  ^  0,  we  see 
that  the  inequality  of  Eq.  (3.3)  will  be  satisfied  if  and  only  if 
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PjlvJiP^v)  Vv  e[0,  1]  (3.4) 

With  the  Inequality  holding  for  at  least  one  1.  This  is  the  requirement  for 
first  order  stochastic  dominance.  When  the  inequality  of  Eq.  (3.4)  holds  we 

say  that  ai  dominates  a^  by  first  order  stochastic  dominance  or  a^  f  j  a^. 

We  can  rewrit^  the  expression  for  the  probability  mass  function 

W  =  f  Vv^  dv 

'o 

in  terms  of  discrete  state  probabilities  P^(vA),  t=l,2,...,  k  as 

w  *  A 

XF  1 

If,  in  addition  to  requirinq  monotonicity  of  the  utility  function,  we  also 

2  2 

require  risk  aversion ;then  we  impose  the  further  requirement  that  d  u(v)/dv  = 
u"(v)  0.  We  integrate  Eq.  (3.3)  by  parts  to  obtain 

u'(l)  r(l)  -  f  r(v)  u"(v)  dv  <_ 0 
0 


where 


r(v)  =  f'  [P.j (a)  -  Pj(a) J 


To  satisfy  this  requirement  for  u'(l)  >_  0  and  u"(v)  <^0,we  must  require 
r ( v )  £0  in  the  interval  0  to  1.  Our  requirement  for  what  is  called 
second  order  stochastic  dominance  becomes,  therefore. 


f  V  [P,- («)  -  Pj  (a)]  da  <  0,  Vv  e[0,  1J 


(3.5) 


For  the  finite  state  case  we  replace  Eq.  (3.5)  with 


l  Pj(v£)  -  Pj(v^)  [vx+1  -  v^J  <_  0,Vk  e[2,  n] 


(3.6) 


with  the  inequality  holding  for  at  least  one  k. 

An  excellent  discussion  of  stochastic  dominance  concepts  is  presented  in  the 
chapter  by  Fishbum  and  Vickson  in  [29]. 
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In  the  general  case  we  can  write  the  requirement  for  k**1  order 
stochastic  dominance  of  alternative  a^  over  a^,  ^  a^»  as 

rk(v)  i  0  V  v  s  [0,1]  (3.7) 

where 


r^v)  =  P^v)  -  Pj(v) 

Satisfaction  of  Eq.  (3.7)  will  insure,  for  increasing, k,  various  increasing 

t  b 

requirements  on  risk  aversion  of  the  form  u  (v)  ^  0,  u"(v)  <_0,...,  (-1) 
uk(v)  <  0. 

A  particularly  interesting  case  occurs  for  k  =  ®.  The  utility  curve 
for  infinite  risk  aversion  is  given  by  u(v)  =  0,  v  =  0  and  u(v)  *  1  Vve(0,1]. 
Generally,  it  will  be  relatively  easy  to  determine  requirements  for  infinite 
order  stochastic  dominance?  Since  the  strength  of  the  dominance  relation 
increases  with  increasing  order,  we  can  use  this  concept  to  advantage, 
especially  in  the  multiattribute  case.  We  note  that  we 
will  be  able  to  determine  first  order  dominance,  and  infinite  order  dominance, 
for  many  discrete  state  problems  with  only  ordinal  event  outcome  preference 
information.  Value  preference  bounds  may  be  determined  from  ordinal  preference 
information  from  higher  order  stochastic  domination  concepts.  This  requires 
the  solution  of  linear  programs,  much  the  same  as  those  of  Eqs.  (2.12)  through 
(2.14)  t27-2al. 

Mean  variance  dominance,  or  expected  value  dominance,  is  a  concept 
that  has  often  been  used,  especially  in  capital  budgeting  efforts.  Alternative 
a*  dominates  alternative  a^  in  terms  of  expectation  or  mean  value  domination 
If  it  has  a  greater  expected  value  such  that 

*We  can  also  compute,  with  relative  ease,  the  expected  utility  for  the  modi¬ 
fied  Infinite  risk  aversion  case  where  u(v)=0,  vvtlO,  v,l  and  u(v)=l, 

Vvt  (ij,  1J.  1 


(3.8) 


U  *  f  vp.(v)  d v>f  vp.(v)  dv  *  a4 
y0  1  >0  J  J 


Alternative  a1  dominates  alternative  a^  In  terms  of  variance  if  the  variance 
associated  with  alternative  i  is  less  than  that  associated  with  alternative  j. 


/  v2  p.{v)dv  -  a  ?  <_  f 1  v2p.(v)dv 
n  *  *  f\  .  j 


(3.9) 


or 


When  an  alternative  dominates  another  alternative  in  both  expectation 
and  variance,  it  is  said  to  dominate  It  in  an  EV  domination  sense.  Generally, 
domination  in  either  expectation  or  variance  Is  not  necessarily  meaning¬ 
ful.  And  even  EV  domination  Is  a  less  valuable  concept  than  the  various 
stochastic  dominance  concepts,  in  that  one  can  easily  configure  problems 
for  which  a  non  preferred  alternative,  that  is  one  either  stochastically 
dominated  by  another  alternative  or  with  a  lower  expected  utility  than 
another  alternative,  may  dominate  another  alternative  in  an  EV  domination 
sense  [28].  Thus  the  EV  domination  concept  must  be  used  with  caution. 

As  an  example  of  sensitivity  calculations  which  use  stochastic  dom i- 


nation  concepts,  we  consider  the  problem  posed  by  Table  3.1. 


A1 ternati ve 

X1 

v  (x-j )  =0 

St 

x2 

vfx?)=o.25 

ate 

x3 

v(x3)=0.5 

x4 

v(x4^0.75 

x5 

v(Xg)=l .0 

a1 

0.25 

0.25 

0.25 

0.25 

0 

a2 

0 

0.25 

0.25 

0.25 

0.25 

a3 

0.15 

0.15 

0.20 

0.25 

0.25 

a4 

0.20 

0.80 

C 

0 

0 

a5 

0.50 

0 

0 

0 

0.50 

a6 

0 

0 

1.0 

0 

0 

Table  3.1  Probability  of  Occurrence  of  Various  Event  Outcome  States 
(snow  also  are  cardinal  values,  which  are  used  In  some 
calculations) 

For  first  order  stochastic  dominance  we  have,  from  Eq.  (3.4),  the  first 
order  stochastic  dominance  reachability  matrix  and  digraph  [21]  show  In 
Figure  (3.1).  We  note  that  we  need  only  use  the  ordinal  preferences  Infor¬ 
mation  among  state  values  to  determine  this  domination  relationship. 
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We  must  know  cardinal  values  In  order  to  use  second  and  higher  order 
domination  relations,  however.  Bounds  on  these  values  can  be  utilized,  and 

we  can  consider  multivariate  multlattrlbute  outcomes, 
as  discussed  in  [27J  ,  |2£f]  and  ]_29J .  Unfortunately,  this  requires  resolution 

of  a  number  of  linear  programs  and  this  can  be  computationally  rather 
unattractive.  If  we  use  the  cardinal  values  specified  In  Table  3.1,  It  is 
a  simple  matter  to  use  Eq.  (3.5)  or  Eq.  (3.6)  to  obtain  the  reachability 
matrix  and  minimum  edge  digraph  shown  in  Figure  3.2.  We  note  that  first 
order  stochastic  dominance  Insures  second  order  stochastic  dominance. 

Thus,  there  Is  no  need  to  determine  dominance  for  the  dominated  relations 
of  Figure  3.1.  From  Figure  3.1  we  see  that  the  only  possible  dominance 


greater  than  n 


It  can  be  a  rather  peslmlstlc  criterion,  therefore.  It  may  well  turn  out  that 

alternative  a3  Is  preferred  to  alternative  a6  for  a  more  realistic  utility  function. 

We  next  examine  EV  domination  and  easily  establish  the  results 

shown  In  Figure  3.4.  From  this  figure  we  Indeed  see  that  domination 

based  on  expectation  only  Is  a  poor  Indicator  to  use  for  choicemaking. 

Although  the  EV  dominance  digraph  shown  In  Figure  3.4C  Is  slightly 

different  from  that  obtained  using  the  second  order  stochastic  domination 

2  3  6 

results.  It  does  Indicate  that  the  best  three  alternatives  are  a  ,  a  ,  a  . 

To  determine  the  final  choice  alternative  we  might  assume  a  standard 
exponential  relationship,  expressing  constant  risk  aversion  r,  to  relate 
utility  and  value.  Here  we  will  use 


u(v) 


1  -  e 


-rv 


1  -  e 


-r 
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The  expected  utilities  for  alternatives  a  ,  a  ,  a  are  easily  determined 

for  various  r  as  shown  In  Figure  3.5.  There  Is  no  way,  of  course,  that  a 

2  6 

can  be  the  preferred  alternative  since  It  Is  dominated  by  a  .  a  can  be 
either  the  most  preferred,  the  second  most  preferred,  or  the  third  most 
preferred  alternative  depending  upon  the  amount  of  risk  aversion. 

Figure  3.5  Indicates  transition  points  where  the  various  optimum  decision 
alternatives  change. 


4.  Sensitivity  In  Scalar  Multiple  Attribute  Utility  Analysis 


Much  contemporary  emphasis  has  been  placed  on  the  evaluation  of 
alternatives  using  multiple  attribute  utility  theory.  The  numerical 
utility  that  results  from  use  of  multi attribute  utility  theory  depends 
upon  the  structure  of  the  multiple  attribute  utility  function,  the  scaling 
coefficients  within  this  structure,  and  the  Individual  single  attribute 
utility  functions  which  are  aggregated  to  determine  the  multiple  attribute 
utility  functions. 

Flshburn  [8,9]  has  considered  approximations  of  scalar  multi attribute 
utility  functions  In  which  u(x)  Is  a  continuous  real  valued  scalar  cardinal 
utility  function  and  v(x)  Is  an  approximation  for  u(x).  A  number  of 
approximations  to  u(x)  of  the  general  form 


v(x)  =  v(x.,  x?,...,  x  )  *  t  f,  (x,)  f?  (xj...  f  (x  ) 
12  "  j*l  1  2  nj  n 

are  considered.  A  distance  metric  In  the  form  of  the  uniform  norm 


D(u,  v)  =  sup  |  u(x)  -  v(x) | 

Is  minimized.  Among  the  results  of  these  efforts,  the  following  are  especially 
significant: 

1.  An  additive  utility  function  u(x)  can  be  approximated  to  arbitrary 

closeness  by  the  multiplicative  form 
n 

v(x)  =  n  V(xJ 
1=1  1 

2.  If  u(x)  Is  multiplicative,  then  there  is  a  lower  bound  on  the 
distance  between  the  actual  utility  and  an  additive  approximation 

One  of  the  Interesting  conclusions  of  this  effort  is  that  simple  additive 
approximations  may  function  as  well  as  the  more  complicated  multiplicative 


approximations  for  cases  In  which  the  true  utility  function,  u(x).  Is 
neither  multiplicative  nor  additive. 

Much  effort  has  been  devoted  to  parameter  sensitivity  In  determinis¬ 
tic  additive  models.  Among  the  most  useful  results  obtained  from  these 
studies  Is  the  Indication  that  differential  weighting  of  attributes  Is 
often  not  necessary  and  that  equal  weighting  will  perform  essentially  as 
well  when  all  attributes  have  a  high  positive  correlation  with  each  other. 
Leung  [14]  provides  a  survey  of  much  of  this  work  with  a  number  of 
references  to  contemporary  literature. 

Among  the  more  useful  of  sensitivity  type  results  that  can  be 
established  for  multi attribute  decisionmaking  under  certainty  are  various 
types  of  dominance  results  for  the  case  where  attribute  scores.  In  the 
range  0  to  1,  can  be  established  for  each  alternative.  In  the  most 
unspecified  case  nothing  Is  known  about  the  n  weights  for  an  assumed 
linear  multi  attribute  utility  function  except  that 

Wj  >_  0,  1  =  1 ,  2,. . . ,  n  (4.1) 

n 

E  w.  =  1  (4.2) 

1«1  1 

uJ  -  u(aj)  *  wV  »  e  w.u.(a^)  *  e  w.uj  (4.3) 

1*1  11  1-1  1  1 

If  It  turns  out  that  u^  >_  u![  Vi,  with  the  Inequality  holding  for 

at  least  one  1,  then  we  easily  see  that  alternative  j  must  have, regardless 

of  tne  weights,  a  greater  utility,  u(a^),  than  alternative  k.  We  say  that 
1  k 

a'1  oomlnates  a  .  If  we  nave,  for  example, 
u1  ■  0.2  Wj  +  0.2  w g 
u2  ■  0.5  Wj  ♦  0.2  Wg 
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u3  »  0.3  w1  +  0.2  w2 

4 

u  ■  0.5  Wj  +  0  w2 

then  we  see  that  a  ^  a  ,  a  £.  a  ,  and  a4  £_  a*  for  any  w^  and 

w2  subject  to  Eqs.  (4.1)  and  (4.2).  Figure  4.1  Illustrates  these 

four  utilities  and  the  associated  dominance  relations.  We  see  from  this 

figure  that  there  Is  no  dominance  of  alternative  3  by  alternative  1; 
nor  Is  there  doml nance  of  alternative  3  by 

alternative  4.  Yet  we  see  that  there  are  no  values  of  the  weights 

3  14 

such  that  a  Is  preferred  to  a  and  a  .  We  may  establish  this  fact 

by  noting  that  the  requirements  for  a  £  a  ,  which  Is  w-j  >_  w2,  and 
3  /  4 

a  fc_  a  ,  which  Is  w2  :>  2w^,  are  Inconsistent. 

In  the  general  case  where  utilities  are  defined  by  Eq.  (4.3)  and 
the  constraints  of  Eqs.  (4.1)  and  (4.2)  hold,  we  can  show  that  alterna* 
tlve  k  will  be  dominated  by  a  mixed  strategy  of  the  (m-1)  remaining 
alternatives  If  there  is  a  non  zero  (positive)  solution  J  to  the  linear 
programming  problem 

m  k 

J  *  min  Z  d.  (4.4) 

1»1  1 
Ifk 

W|  >  0  ,  1  *  1,2,...,  n 


n 

z  w.  ■  1 
1-1  1 


dj  >  0,  j  «  1,2,...,  k-1,  k+1,...,  m  (4.5) 


z  w.(u!f  -  u|)  +  d.  1  0,  j-1,2,...,  k-1,  k+1,...,  m 
1  1  1  J 


(4.6) 
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When  we  compare  alternative  3  with  a  mixed  strategy  of  alternatives 
1  and  4  we  see  that  the  foregoing  relations  become 

J  *  m1n(d^  +  d^ 

w1  >  0 

«2>  0 
W]  +  w2  =  1 

df>  0 
dj>  0 

3 

.1  Nj  -  .1  w^  +  d|  ^  0 

-0.2  w1  +  0.1  w2  +  dj  >  0 

The  solution  to  this  linear  programming  problem  Is 

*1  ■  °->  -  °-z  *  «i  i  °-5 

dj  =  0.3  w]  -  0.1  V  >  0.33 

We  see  that  there  Is  a  non  zero  J  over  the  entire  range  of  w^  and  thus 
note  again  that  alternative  3  Is  dominated  by  a  mixed  strategy  of 
alternatives  1  and  4. 

In  many  cases  It  will  be  possible  for  the  decisionmaker  to  express 
ordinal  weights,  or  bounds,  on  the  weights  w^  In  the  form 

*1  i  w2  1  •••  *n  - 0  (4-7) 

Suppose  also  that  It  turns  out  that 


*  u,  +  c 


u3  "  u3  +  e3  •  e2 

uj  +  El  -  e1.1  (4.8) 


where  >_  0  V  1.  Then  we  have  for  the  utility  of  alternative  j 

4  n  4  n  ^ 

uJ  *  £  Wi  uj  *  £  w. (u.  +£,-£..) 

1=1  1  1  1-1  1  1  1  1-1 

where  cQ  -  0.  We  can  write,  by  changing  the  summation  Index, 


1-1 


*1  E1-l 


n-1 
£  w 
1-0 


1+1  E1 


such  that  Eq.  (4.8)  becomes,  using  Eq.  (4.3), 

uJ*ukt  V  «,  <«,  •  «„|)  *  ‘  ,  «n 


(4.9) 


Since  we  know  that  ei  >  0  and  w^  >.  w1+1  >_  0,  we  have  established  the  fact 
that  If  the  equalities  of  Eq.  (4.8)  hold,  we  must  have  a^  ^  a*  regardless 
of  the  value  of  the  weights.  Equation  (4.8)  Is  not  In  the  form  most 
suited  for  actual  use  and  can  easily  be  rewritten  In  terms  of  the 
cumulative  difference  Inequality 


m  .  m  . 

£  iri  >  £  u?  ,  m  -  1,2,...,  n  (4.10) 

1-1  1  1-1  1 
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which  Is  In  a  form  quite  suitable  for  actual  use. 

For  the  four  alternatives  and  utilities  considered  earlier  In 

this  section  we  still  have  dr  £  a  ,  a*  fc.  aJ  and  a c  a  .  We 

also  have  a^fc.  a3,  a3  a1,  and  the  Implied  transitive  preference, 

a  a  as  well.  In  this  particular  case,  specifying  an  ordinal 

scale  for  the  attribute  weights  has  completely  ordered  the  (dominance) 

preference  relationship.  As  Indicated  In  Figure  4.2,  the  Imposition 

of  the  constraint  w-j  >_  w2  simply  eliminates  the  right  half  of  the 

space  In  Figure  4.1  where  w2  >.  0.5. 

Even  though  alternative  k  may  not  be  dominated  by  alternative  j. 

It  may  or  may  not  always  have  a  lower  utility  than  the  mixed  strategy  of 

alternative  1  or 

alternative  j.  For  example  In 

u  *  0.6  w1  +  0.4  w2 

u6  =  0.3  w]  +  0.9  w2 

u7  »  0.7  w^  +  0.2  w2 

we  see  that  alternative  5  Is  not  dominated  by  alternative  6  or  alterna¬ 
tive  7  If  >.w2.*  However  In  order  to  have  a3  £  a6  and  a5  a 7  we 

must  have 


W1  i  w2 


0.6  w^  +0.4  Wjj  _>  0.3  W'j  +Q.9  w2 

0.6  w.j  +0.4  w2  >  0.7  w.|  +0.2  w2 
or 

1.67w2  <.  w^  <  2  w2 


m  alternative  6  dominates  alternative  5  as  can  be  shown. 


or,  since  w2  =  ^  “  w1' 

5/8  <  w]  <  2/3 

Thus,  dominance  of  a  over  st  and  a  Is  not  guaranteed  except  over  a  small 
range  of  On  the  other  hand  if  we  have 

u8  *0.8  w-j  +0.1  w2 

then  we  will  have  a5  a6  and  a5V  a8  only  if 
1.67  w2  <  w,  <  1.5  w2 

and  this  is  in  consistent.  Thus  alternative  5  can  not  be  the  alternative 
with  the  highest  utility  In  that  the  utility  of  alternative  6  or  alter¬ 
native  8  is  always  greater  than  this.  Figure  4.3  illustrates  preference 
relationships  among  alternative  5,  6,  7,  and  8  as  obtained  here. 

For  the  general  case  where  the  attribute  weights  are  ordered  as 
In  Eq.  (4.7),  It  turns  out  that  alternative  k  will  be  dominated  by  a 
mixed  strategy  of  the  (m-1)  remaining  alternatives  if  there  is  a  non 
zero  solution  J  to  the  linear  programming  problem 

J  *  min  E  d![  (4.11 ) 

1*1  1 
1*k 

"■j  i  *2  -  •"  -  wn  -  0 

n 

E  W,  *  1 
1*1  1 

dj  >  0,  J  *  1,2,...,  k-1 ,  k+1 , . . . ,  m 

E  w.(uj  -  Uj )  +  dj  >_  0,  j  *  1,2,...,  k-1,  k+1 .... ,  m 
1-1  1  1  1  J 
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There  have  been  a  number  of  sensitivity  studies  of  multi attribute 
utility  in  the  psychological  literature  [3-5,  24,  30]  and  the  effect  of 
errors,  including  cognitive  bias  induced  errors,  upon  risk  and  uncer¬ 
tainty  estimation  [22].  A  major  goal  of  this  psychological  research 
is,  a  theory  of  errors.  This  will  allow  determination  of  the  effects 
of  poor  structuring  of  decision  situation  models  and  poor  elicitations 
of  values  and  uncertainties  and  the  aggregation  of  these  into  decision 
rules.  A  to  be  hoped  for  achievement  of  all  of  this  research  is  a 
theory  that  explains  and  clarifies  descriptive  and  prescriptive  approa¬ 
ches  to  substantive  and  procedural  judgment  and  decision  processes  such 
as  to  enable  the  design  of  more  efficacious  systems  for  planning  and 
decision  support.  In  this  section  we  have  Indicated  how  sensitivity 
results  can  be  used  to  this  end,  and  how  sensitivity  analysis  can  be 
used  to  reduce^ often  considerably,  the  needed  number  of  precise  weights. 
This  should  generally  reduce  the  potential  cognitive  stress  involved 
in  decision  analysis  efforts.  Some  rather  general  results  concerning 
partially  identified  parameters  and  associated  sensitivity  analysis 
for  planning  and  decison  support  are  given  in  [28]. 


5.  Sensitivity  and  the  Structure  of  Decision  Situation  Models 

Sensitivity  analysis  results  can  be  used  to  guide  the  structuring  of 
decision  situations.  This  has  been  the  thrust  of  recent  efforts  by 
Leal, Pearl,  and  Saleh  [13,  16]  ;  Merkhoffer  et.  al.  [15];  and  Rajala  and 
Sage  [17-20].  Of  interest  also  is  the  related  work  of  Chen  and  Jarboe  [2]> 

Haruna  and  Komoda  [10];  and  Howard,  Matheson,  and  North  [11]. 

Use  of  sensitivity  measures  to  guide  the  structuring  of  decision  trees, 
and  related  structures  such  as  fault  trees,  requires  the  availability  of 
preference  or  utility  measurements  for  event  outcomes  and  uncertainty 
measures  over  events.  There  are  four  concepts  of  value  in  structuring 
decision  trees  using  sensitivity  concepts: 

(1)  sensitivity  differential  of  a  node 

(2)  relative  sensitivity  differential  of  a  node 

(3)  expected  value  of  resolving  residual  uncertainty 

(4)  decision  sensitivity  to  outcome  variable  uncertainty  resolution 

The  sensitivity  differential  of  a  node.  A,  is  the  change  that  must  occor  in 

the  value  of  that  node  in  order  to  cause  a  change  in  the  currently  best  initial 

decision.  In  Figure  5.1  for  example,  a  decrease  in  the  value ?  or  utility, 

v(x,  d)  at  node  B  of  more  than  0.95  units  will  cause  the  best  initial  decision 
1  3 

to  switch  from  a  to  a  .  It  would  require  a  decrease  of  -0.125  units  in 
the  value  at  node  E,  for  example,  for  this  to  happen.  A  recursive  relation 


node  i  is  an  event  node 

4(f)-  P1 

(  A(i-l)  +  _i (x )  -  v^(x)»node  i  is  a  decision  node 


may  be  determined  [13],  Here  A(i)  is  the  sensitivity  differential  associated 

*We  use  the  value  symbol  for  convenience.  All  of  the  discussion  in  this  section 
applies  to  utilities  as  well  as  to  values. 
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with  node  1  and  a(i-l)  is  the  sensitivity  differential  of  the  preceeding 
node.  v.j(x)  and  v^_j(x)  refer  to  the  expected  values  at  nodes  i  and  i-1. 
The  relative  sensitivity  differential  of  node  i  is  given  by 


sr(i) 


°y(i  ) 

Tny 


where  oy(i)  is  the  anticipated  change  in  the  value  at  node  i  which  may 
result  from  further  refinement.  Unfortunately  there  is  no  general  way  to 
determine  ay(i)  except  by  elicitations  from  the  decision  maker.  It  is 
reasonable  that  oy(i)  is  linearly  proportional  to  v^(x)  since  greater 
Inaccuracies  typically  are  associated  with  larger  values. 

The  expected  value  of  resolving  residual  uncertainty  ( EVRRU)  may  be 
easily  computed  [15].  We  assume  that,  in  Figure  6.2,  the  current  best 
decision  is Ta^ ,  a\  The  following  results  are  obtained: 

1.  The  EVRRU  is  zero  if  we  consider  a  node,  such  as  node  1,  in  which 

the  node  is  along  a  path  leading  from  the  current  best  initial 

1  r  1  4 

decision,  a  ,  but  not  the  best  current  decision  la  a  J. 

2.  The  EVRRU  is  zero  if  we  consider  a  node  such  as  node  2,  in  which 
the  node  is  along  a  path  leading  from  the  current  best  initial 
decision,  a\  but  where 

Pi  [ v ( x ,  a1,  a4)  -  v(x ,  a1,  a5)]  <  v(x,  a1)  -  v(x,  a2) 

3.  For  case  2,  the  EVRRU  is  given  by 

EVRRU  =  P.P.  f  [v2(x)  +  A-  m2J 
i  j 

2  2 

where  f  =  prob  [v*  (x)<  v  (x)  +  Aj 

m2  =  E  [v*^(x)|  v*2(x)i  v(x)  +a] 
if  the  inequality  in  case  2  is  reversed. 
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4.  If  we  consider  node  3  which  is  not  along  the  path  leading  from  the 
best  Initial  decision,  then  we  have 
EVRRU  =  -  PL  Pm  g  [ v3(x)  +A  -  m*] 

3  3 

where  g  =  prob  [v*  (x)  >_  v  (x)  +  Aj 

m*  =  E  [v*3(x)|  v*3(x)  >  v(x)  +AJ 

Rajala  and  Sage  [18]  have  developed  a  9  step  tree  expansion  structuring 
procedure  based  upon  these  sensitivity  relations.  Steps  in  this  procedure 
are: 

1.  Identify  the  initial  decision  alternatives  and  represent  them  by 
branches  emanating  from  the  first  decision  node. 

2.  Identify  state  variables  of  importance  in  determining  the  value  of 
each  alternative. 

3.  Elicit  a  value  or  utility  function. 

4.  Encode  provisional  probability  distributions  on  each  state  variable 
for  each  alternative  course  of  action 

5.  Using  the  value  model  compute  probability  distributions,  f  and  g, 
on  the  rollback  value  at  the  terminal  nodes  and  each  interior  node 
using  the  state  variable  distributions. 

6.  Determine  the  next  appropriate  node  for  expansion.  Either  the 
EVRRU  and/or  the  relative  sensitivity,  sr (i ) ,  is  appropriate  as  an 
aid  in  this  determination.  If  either,  or  both  of  these  are  below 
some  threshold  for  all  remaining  nodes  we  stop  expansion  of  the  tree. 
Otherwise  we  go  to  step  7. 

7.  The  sensitivity  of  the  current  best  initial  decision  to  uncertainty 
resolution  in  each  state  variable  is  determined.  Multi  attribute 


utility  functions  are  especially  appropriate  to  aid  In  this  task. 
8.  We  verify  that  the  best  course  of  action  may  be  affected  by  Incor¬ 


porating  factors  determined  In  steps  6  and  7  Into  the  decision 
model.  Often  this  can  be  accomplished  by  determining  whether 
the  event  probability  required  for  a  decision  switch  converges 
to  an  amount  less  than  or  equal  to  the  amount  elicited  from  the 
decisionmaker.  If  It  does  we  go  to  step  9.  If  It  does  not  we 
return  to  step  7  and  repeat  this  step  until  we  are  convinced  that 
no  switch  In  the  decision  Is  feasible. 

9.  Incorporate  relevant  features  In  the  decision  tree  to  obtain  a 
new  and  improved  representation  of  the  decision  situation.  We 
return  to  step  4  and  continue  the  process  until  the  EVRRU  and/or 
sr(1)  are  sufficiently  low  at  all  remaining  nodes  such  that  we 
conclude  that  no  further  Improvement  in  the  decision  situation 
structural  model  is  feasible. 

We  shall  limit  our  discussion  concerning  the  value  of  information 
measures  to  a  primary  decision  situation  that  involves  only  a  single 
decision  d  whose  uncertain  outcomes  are  represented  by  the  discrete  state 
variables  (x-|,...,  xn).  The  uncertainty  on  this  state  vector  x  Is  encoded 
in  the  distribution  f(x)  and  the  value  of  the  outcome  is  measured  by  the 
value  model  v(x,  d). 

The  purpose  behind  considering  the  possibility  of  acquiring  addi¬ 
tional  Information,  given  this  complete  model  of  the  primary  decision 
situation.  Is  to  determine  the  worth  of  eliminating  remaining  uncer¬ 
tainty  on  the  state  variables.  An  Important  quantity  which  establishes 
an  upper  bound  to  the  amount  that  the  decisionmaker  should  pay  to  elimi¬ 
nate  all  uncertainty  on  a  state  vector  Is  the  value  of  perfect  Information. 
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If  a  clairvoyant,  an  Individual  capable  of  Indicating  the  exact 
outcome  of  an  uncertain  quantity,  were  to  report  to  the  decisionmaker 
that  a  particular  state  vector  x1  would  occur,  then  the  decisionmaker 
could  select  the  appropriate  course  of  action  d*  that  gives  the 
maxlmlmum  value,  denoted  by  v(x1,  d*) .  However,  since  the  decision¬ 
maker  does  not  know  what  x1  the  clairvoyant  would  report,  the  value 
that  would  be  realized  from  a  particular  outcome  must  be  weighted  by 
the  probability  that  the  outcome  will  be  reported.  The  probability 
that  Is  assigned  Is  just  the  prior  probability,  f(x^).  To  the 
decisionmaker,  the  expected  value  of  the  decision  situation  with  per¬ 
fect  Information  is 

E[v(x,  d*)]  =  z  f^Mx1,  dj 
1 

The  well  known  expected  value  of  perfect  information,  EVPI,  which  is  a 
measure  of  the  upper  bound  the  decisionmaker  should  be  willing  to  pay 
to  resolve  all  uncertainty  on  a  state  vector  x,  is  the  difference  between 
the  quantity  determined  In  the  equation  above  and  the  expected  value  of 
the  optimal  course  of  action  based  only  on  information  encoded  from  the 
decisionmaker's  prior  knowledge  and  experience,  that  is 

EVPI  *  E[v(x,  d*)]  -  max  E[v(x,  d}] 

d 

=  z  f(x1)v(xk,  d*)  -  max  z  f(x*)v(xk,  d) 

1  d  1 

The  magnitude  of  EVPI  can  assist  the  analyst  In  determining  the  level 
of  effort  to  be  directed  toward  Identifying  and  organizing  Information 
gathering  decisions  Into  the  decision  model.  A  lower  magnitude  of 
EVPI  generally  warrants  a  lower  level  of  structuring  activity.  These 
methods  provide  a  basis  which  allows  the  analyst  to  prompt  the  decision¬ 
maker  Into  Identifying  information  gathering  alternatives,  with  EVPI 
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providing  additional  Incentive  to  the  decisionmaker.  The  expected 
value  of  Information  from  these  methods  Is,  of  course,  bounded  above 
by  EVP I,  assuming  no  structural  modelling  errors. 


The  Information  z  obtained  about  the  state  vector  x  from  an 
Information  gathering  alternative  causes  the  decisionmaker's 
experience  and  knowledge  to  change,  and  Its  effect  may  be  completely 
accounted  for  by  a  revision  In  the  probability  distribution  on  x. 

The  revised  distribution  on  x  Is  determined  from  Bayes'  rule 

f(zjx)  f{x) 

f(x|  z)  =  - — - 

f(z) 

where  the  probability  functions  are  appropriately  defined.  The  expec¬ 
ted  value  of  information,  EVI,  Is  the  difference  between  the  optimal 
course  of  action  with  additional  Information  and  the  optimal  course 
of  action  without  additional  Information.  It  Is  computed  as 


EVI  *  V 


max 

d(z,cz) 


E{v[x,  d(z,  c  1}  ]  -  max  E[v(x,  d) ] 
2  d 


=  I  [  max  l  f(x|z)  v[x,  d(z,  cz)]]  f(z) 

2  d(z,c  )  z 

-  max  Z  f(x)v(x,d) 
d  x 

where  d(z,  cz)  Indicates  the  primary  decision  d  Is  based  on  Information 
z  obtained  at  cost  cz-  If  EVI  Is  positive,  then  the  expected  value  of 
the  decision  situation  will  Increase  when  the  secondary  decision  to 
gather  additional  Information  Is  made.  If  EVI  Is  negative,  the  expec¬ 
ted  value  will  decrease,  reflecting  that  Information  costs  more  than  It 
Is  worth.  If  cz«0,  then  EVI  cannot  be  negative. 

Rajala  and  Sage  [17-20]  present  several  examples  of  these  proce¬ 
dures.  These  approaches  are  especially  capable  for  use  as  structuring 
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tools  to  determine  parsimonious  decision  trees  which  are  reflective 
of  the  decisionmaker's  perception  of  the  decision  situation.  Also* 
the  approach  provides  a  general  method  to  use  in  "pruning"  already 
structured  trees.  Of  particular  interest.  In  this  connection,  would 
be  the  ability  to  deal  with  multi  parametric  sensitivity  Issues  [25]. 
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6.  Conclusions 

This  paper  has  presented  a  discussion  of  contemporary  efforts  Involving 
error  and  sensitivity  analysis  of  decision  analysis  algorithms  for  eval¬ 
uation  and  choicemaking  associated  with  planning  and  decision  support.  We 
have  examined  sensitivity  to  probability  estimation  errors,  sensitivity 
to  utility  elicitation  errors,  sensitivity  to  variations  in  the  structure 
and  parameters  of  multi  attribute  utility  functions,  and  sensitivity  to 
variations  In  the  structure  as  well  as  the  probability  and  utility  para¬ 
meters.  This  structural  sensitivity  to  expansion  of  the  decision  tree  Is 
especially  useful  In  that  It  provides  an  aid  In  the  determination  of  par¬ 
simonious  models  of  decision  situations. 

Our  recent  research  has  also  concerned  a  mixed  scanning  based  planning 
and  decision  support  system  which  Involves  a  vector  multiple  attribute 
utility  function  126,  27J.  In  this  approach,  which  Is  believed  behaviorally 
relevant,  we  Intentionally  avoid  elicitation  of  attribute  weights  and  only 
elicit  those  weights  which  can  be  shown  to  be  most  beneficial  in  increasing 
the  domination  pattern  among  alternatives.  Sensitivity  results  of  the  type 
obtained  In  this  paper  have  been  found  useful  In  guiding  the  partial  aggre¬ 
gation  of  values.  This  results  In  a  planning  and  decision  support  system 
In  which  the  attribute  weight  elicitation  procedure  is  guided  by  an  Inter¬ 
action  process  Involving  the  judgment  and  desires  of  the  decision  maker  and 
suggestions  concerning  the  efficiency  of  value  aggregation  that  are  deter¬ 
mined  by  sensitivity  analysis  approaches. 
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Figure  3.2  Reachability  Matrix  and  Minimum  Edge  Digraph  for  Second  Order 
Stochastic  Dominance. 
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Figure  3.3  Reachability  Matrix  and  Minimum  Edge  Digraph  for  Infinite  Order 
Stochastic  Dominance 
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Figure  3.4  EV  Dominance  Results 
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Figure  3.5  Sensitivity  Effect  of  Risk  Aversion  Coefficient  in  Determining  Best  Alternatives 


Figure  4.2  Preference  Relations  for  a  Simple  Example,  w,  >  w, 
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Figure  4.3  Utilities  as  functions  of  attribute  weights.  Note  that  a 
mixed  strategy  of  alternatives  8  and  6  will  always  be 
better  than  alternative  5  or  7. 
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Figure  5.1  Decision  Tree  with  Expected  (rollback)  values  and  sensitivity  Differentials 
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The  University  of  Virginia's  School  of  Engineering  and  Applied  Science  has  an  undergraduate  enrollment 
of  approximately  1 ,400  students  with  a  graduate  enrollment  of  approximately  600.  There  are  1 25  faculty 
members,  a  majority  of  whom  conduct  research  in  addition  to  teaching. 

Research  is  an  integral  part  of  the  educational  program  and  interests  parallel  academic  specialties.  These 
range  from  the  classical  engineering  departments  of  Chemical.  Civil,  Electrical,  and  Mechanical  and 
Aerospace  to  departments  of  Biomedical  Engineering,  Engineering  Science  and  Systems,  Materials 
Science,  Nuclear  Engineering  and  Engineering  Physics,  and  Applied  Mathematics  and  Computer  Science. 
In  addition  to  these  departments,  there  are  interdepartmental  groups  in  the  areas  of  Automatic  Controls  and 
Applied  Mechanics.  All  departments  offer  the  doctorate;  the  Biomedical  and  Materials  Science 
Departments  grant  only  graduate  degrees. 

The  School  of  Engineering  and  Applied  Science  is  an  integral  part  of  the  University  (approximately  1 .530 
full-time  faculty  with  a  total  enrollment  of  about  16.000  full-time  students),  which  also  has  professional 
schools  of  Architecture,  Law,  Medicine,  Commerce,  Business  Administration,  and  Education.  In  addition, 
the  College  of  Arts  and  Sciences  houses  departments  of  Mathematics,  Physics,  Chemistry  and  others 
relevant  to  the  engineering  research  program.  This  University  community  provides  opportunities  for 
interdisciplinary  work  in  pursuit  of  the  basic  goals  of  education,  research,  and  public  service. 


